Papers with modular design
DeepA2: A Modular Framework for Deep Argument Analysis with Pretrained Neural Text2Text Language Models (2022.starsem-1)
Copied to clipboard
| Challenge: | ArgumentAnalyst is a multi-dimensional, modular framework for performing deep argument analysis using existing pre-trained language models (PTLMs). |
| Approach: | They propose a multi-dimensional, modular framework for performing deep argument analysis using current pre-trained language models (PTLMs) ArgumentAnalyst reconstructs argumentative texts as valid arguments by inserting missing premises and conclusions, formalizing inferences, and coherently linking the reconstruction to the source text. |
| Outcome: | The proposed framework can replicate established heuristics, cope with plurality of correct solutions, and exploit higher-order evidence. |
Towards the TopMost: A Topic Modeling System Toolkit (2024.acl-demos)
Copied to clipboard
| Challenge: | Current topic models adopt totally different datasets, implementations, and evaluations, hindering their research progress and applications. |
| Approach: | They propose a Topic Modeling System Toolkit that covers a broader spectrum of topic modeling scenarios with their complete lifecycles. |
| Outcome: | The proposed toolkit covers a broader spectrum of topic modeling scenarios with their complete lifecycles, including datasets, preprocessing, models, training, and evaluations. |
OpenWebAgent: An Open Toolkit to Enable Web Agents on Large Language Models (2024.acl-demos)
Copied to clipboard
Iat Long Iong, Xiao Liu, Yuxuan Chen, Hanyu Lai, Shuntian Yao, Pengbo Shen, Hao Yu, Yuxiao Dong, Jie Tang
| Challenge: | OpenWebAgent integrates large language models and large multimodal models to improve web automation. |
| Approach: | They propose to integrate large language models and large multimodal models into an open toolkit to optimize web automation. |
| Outcome: | The open toolkit integrates both large language models (LLMs) and large multimodal models (LMMs) it enables the development of powerful, task-oriented web agents, significantly enhancing user experience and operational efficiency on the web. |
SentSpace: Large-Scale Benchmarking and Evaluation of Text using Cognitively Motivated Lexical, Syntactic, and Semantic Features (2022.naacl-demo)
Copied to clipboard
| Challenge: | SentSpace provides a framework for streamlined evaluation of textual input. |
| Approach: | They describe the design of SentSpace and demonstrate an example use case . they use a web interface for interactive visualization and comparison with large corpora . |
| Outcome: | The framework provides a common framework for evaluation and visualization. |
SAMP: A Model Inference Toolkit of Post-Training Quantization for Text Processing via Self-Adaptive Mixed-Precision (2023.emnlp-industry)
Copied to clipboard
| Challenge: | Existing methods for quantization of models are too complicated and can cause performance damage. |
| Approach: | They propose a self-adaptive mixed-precision (SAMP) toolkit to automatically control quantization rate by a mixed-presence architecture to balance model accuracy and efficiency. |
| Outcome: | The proposed toolkit has a higher speedup than PyTorch and FasterTransformer while ensuring the required accuracy. |
PEFT-Factory: Unified Parameter-Efficient Fine-Tuning of Autoregressive Large Language Models (2026.eacl-demo)
Copied to clipboard
| Challenge: | Parameter-Efficient Fine-Tuning (PEFT) methods address the increasing size of Large Language Models (LLMs). |
| Approach: | They propose a framework for efficient fine-tuning Large Language Models (LLMs) they aim to train only a small percentage of the full model's parameters . |
| Outcome: | Xu et al., 2023; Ding e t al, 2024; Lialin e al. 2023) show that using PEFT methods can improve performance. |
TencentPretrain: A Scalable and Flexible Toolkit for Pre-training Models of Different Modalities (2023.acl-demo)
Copied to clipboard
Zhe Zhao, Yudong Li, Cheng Hou, Jing Zhao, Rong Tian, Weijie Liu, Yiren Chen, Ningyuan Sun, Haoyan Liu, Weiquan Mao, Han Guo, Weigang Gou, Taiqiang Wu, Tao Zhu, Wenhang Shi, Chen Chen, Shan Huang, Sihong Chen, Liqun Liu, Feifei Li, Xiaoshuai Chen, Xingwu Sun, Zhanhui Kang, Xiaoyong Du, Linlin Shen, Kimmo Yan
| Challenge: | Several pre-training models of different modalities are showing a rising trend of homogeneity in their model structures. |
| Approach: | They propose a toolkit that supports pre-training models of different modalities. |
| Outcome: | The proposed toolkit can match the performance of the original implementations on text, vision, and audio benchmarks. |
Towards Process-Oriented, Modular, and Versatile Question Generation that Meets Educational Needs (2022.naacl-main)
Copied to clipboard
| Challenge: | NLP-powered automatic question generation (QG) techniques have not been widely adopted in classrooms to date. |
| Approach: | They propose to identify key impediments and improve the usability of NLP-powered automatic question generation techniques by understanding how instructors construct questions and identifying touch points to enhance the underlying NLP models. |
| Outcome: | The proposed methods can be used by 11 instructors across 7 universities and highlight their needs and needs when creating questions. |
BioGraphia: A LLM-Assisted Biological Pathway Graph Annotation Platform (2025.emnlp-demos)
Copied to clipboard
| Challenge: | Existing methods for obtaining pathway information from biomedical literature rely on simplifying assumptions that limit their ability to capture true complexity of biological reactions. |
| Approach: | They propose a web-based platform to facilitate collaborative pathway graph annotation. |
| Outcome: | The platform supports multi-user collaboration with real-time monitoring, curation, and interactive pathway graph visualization. |
DecIF: Improving Instruction-Following through Decomposition (2026.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to obtain high-quality instruction-following data rely heavily on existing documents and existing methods. |
| Approach: | They propose a data synthesis framework, DecIF, which automatically generates accurate and diverse instruction-following data from scratch for supervised fine-tuning and reinforcement learning. |
| Outcome: | Extensive experiments show that the proposed framework can synthesize accurate instruction-following data for both SFT and RL paradigms compared to baselines. |
Structural Reward Model: Enhancing Interpretability, Efficiency, and Scalability in Reward Modeling (2025.emnlp-industry)
Copied to clipboard
Xiaoyu Liu, Di Liang, Hongyu Shan, Peiyang Liu, Yonghao Liu, Muling Wu, Yuntao Li, Xianjie Wu, Li Miao, Jiangrong Shen, Minlong Peng
| Challenge: | Generative RMs (GRMs) lack contextual and background information during inference, leading to incomplete evaluations. |
| Approach: | They propose a modular and interpretable framework that integrates side-branch models as auxiliary feature generators. |
| Outcome: | The proposed framework outperforms scalar and saline reward models in robustness and alignment with human preferences. |
CoLLiE: Collaborative Training of Large Language Models in an Efficient Way (2023.emnlp-demo)
Copied to clipboard
Kai Lv, Shuo Zhang, Tianle Gu, Shuhao Xing, Jiawei Hong, Keyu Chen, Xiaoran Liu, Yuqing Yang, Honglin Guo, Tengxiao Liu, Yu Sun, Qipeng Guo, Hang Yan, Xipeng Qiu
| Challenge: | Large language models (LLMs) are increasingly pivotal in a wide range of tasks . however, the resources required for training these models necessitate efficient solutions . |
| Approach: | They propose a library that facilitates collaborative training of large language models . they use 3D parallelism, parameter-efficient fine-tuning methods and optimizers . |
| Outcome: | The proposed library has proven superior training efficiency in comparison with prevalent solutions in pre-training and fine-tuning scenarios. |
Combining Parameter-efficient Modules for Task-level Generalisation (2023.eacl-main)
Copied to clipboard
| Challenge: | A modular design encourages neural models to disentangle and recombine different facets of knowledge to generalise more systematically to new tasks. |
| Approach: | They propose a modular neural network where a subset of latent skills is associated with a parameter-efficient model adapter. |
| Outcome: | The proposed model improves sample efficiency and few-shot generalisation in supervised learning compared to baselines. |
LAW: Legal Agentic Workflows for Custody and Fund Services Contracts (2025.coling-industry)
Copied to clipboard
William Watson, Nicole Cho, Nishan Srishankar, Zhen Zeng, Lucas Cecchi, Daniel Scott, Suchetha Siddagangappa, Rachneet Kaur, Tucker Balch, Manuela Veloso
| Challenge: | Currently, there are limited resources available to build a legal domain-specific Large Language Model (LLM) however, legal contracts are highly varied not only in terms of semantics but also accessibility. |
| Approach: | They propose a Large Language Model (LLM) that integrates multiple specialized agents and text agents to respond to user queries. |
| Outcome: | The proposed model outperforms the baseline model in complex tasks such as calculating a contract’s termination date by 92.9% points. |
LinkAlign: Scalable Schema Linking for Real-World Large-Scale Multi-Database Text-to-SQL (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing Text-to-SQL models fail to address schema linking problems in large-scale multi-database environments. |
| Approach: | They propose a framework that aims to enable non-expert users to retrieve data effortlessly . they highlight four core errors leading to schema linking failures . |
| Outcome: | The proposed framework outperforms baselines on all schema linking metrics. |
EasyDistill: A Comprehensive Toolkit for Effective Knowledge Distillation of Large Language Models (2025.emnlp-demos)
Copied to clipboard
| Challenge: | In this paper, we present EasyDistill, a comprehensive toolkit designed for effective black-box and white-box knowledge distillation (KD) of large language models. |
| Approach: | They propose a toolkit for effective black-box and white-box knowledge distillation (KD) of large language models (LLMs). |
| Outcome: | The framework offers data synthesis, supervised fine-tuning, ranking optimization, and reinforcement learning techniques specifically tailored for KD scenarios. |
Parameter-Efficient Neural Reranking for Cross-Lingual and Multilingual Retrieval (2022.coling-1)
Copied to clipboard
| Challenge: | State-of-the-art neural rankers are notoriously data-hungry and rarely used in multilingual and cross-lingual retrieval settings. |
| Approach: | They propose to use Sparse Fine-Tuning Masks and Adapters to transfer rankers trained on English data to other languages and cross-lingual setups by means of multilingual encoders. |
| Outcome: | The proposed methods outperform standard zero-shot transfer with full MMT fine-tuning while being more modular and reducing training times. |
Rethinking Task-Oriented Dialogue Systems: From Complex Modularity to Zero-Shot Autonomous Agent (2024.acl-long)
Copied to clipboard
| Challenge: | Task-oriented dialogue systems are designed to be composed of several functional modules, but lacks a general-purpose instruction-following language model. |
| Approach: | They propose a fully zero-shot autonomous TOD agent that leverages a general-purpose instruction-following language model to decide what to do at each dialogue turn. |
| Outcome: | The proposed agent can perform tasks in real-life scenarios with a general-purpose instruction-following language model. |
Multi-Agent Procedural Graph Extraction with Structural and Logical Refinement (2026.findings-eacl)
Copied to clipboard
Wangyang Ying, Yanchi Liu, Xujiang Zhao, Wei Cheng, Zhengzhang Chen, Wenchao Yu, Yanjie Fu, Haifeng Chen
| Challenge: | Recent advances in large language models (LLMs) show potential for graph extraction, but often yield ill-formed structures or misinterpret logical constructs such as gateways. |
| Approach: | They propose a framework that treats procedural graph extraction as a multi-round reasoning process with structural and logical refinement agents. |
| Outcome: | The proposed framework achieves significant improvements in structural correctness and logical consistency over strong baselines. |
GROOViST: A Metric for Grounding Objects in Visual Storytelling (2023.emnlp-main)
Copied to clipboard
| Challenge: | Several evaluation metrics for visual storytelling do not consider images at all . authors propose a novel evaluation tool that accounts for cross-modal dependencies and temporal misalignments . |
| Approach: | They propose a visual storytelling evaluation tool that evaluates visual grounding . they use cross-modal dependencies, temporal misalignments and human intuitions . |
| Outcome: | The proposed evaluation tool accounts for cross-modal dependencies, temporal misalignments and human intuitions on visual grounding. |
Modularized Transfomer-based Ranking Framework (2020.emnlp-main)
Copied to clipboard
| Challenge: | Recent innovations in Transformer-based ranking models have advanced the state-of-the-art in information retrieval. |
| Approach: | They propose to modularize a Transformer ranker into separate modules for text representation and interaction. |
| Outcome: | The proposed model is faster than previous models and is easier to interpret and understand. |
BABELEDITS: A Benchmark and a Modular Approach for Robust Cross-lingual Knowledge Editing of Large Language Models (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for cross-lingual knowledge editing are limited in their effectiveness and robustness. |
| Approach: | They propose a new CKE benchmark that accounts for the rich variety of entity aliases within and across languages. |
| Outcome: | The proposed method is more effective than state-of-the-art methods and robust against model collapse when subjected to multiple edits. |
TaPERA: Enhancing Faithfulness and Interpretability in Long-Form Table QA by Content Planning and Execution-based Reasoning (2024.acl-long)
Copied to clipboard
| Challenge: | Long-form table question answering often generates paragraph long and complex answers . a prevalent and concerning issue is hallucination, where models generate answers that are coherent yet factually incorrect or irrelevant to the input context. |
| Approach: | They propose a modular framework that decomposes the whole process into three sub-modules . framework produces a QA-based plan first, followed by generating an answer conditioned on this plan . human evaluation results indicate the framework improves strong baselines on accuracy and truthfulness . |
| Outcome: | The proposed framework improves accuracy and truthfulness on the FeTaQA and QTSumm datasets. |
Beyond Factual Accuracy: Evaluating Coverage of Diverse Factual Information in Long-form Text Generation (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing evaluation frameworks for large language models focus on isolated aspects like * Equal contribution. |
| Approach: | They evaluate ICAT, an evaluation framework for measuring coverage of diverse factual information in long-form text generation. |
| Outcome: | The evaluation framework is based on three implementations with different assumptions on availability of aspects and alignment method. |
Simplify-Pro: A Two-level and Progressive LLM-based Framework for Auto Long Text Simplification (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing studies have focused on lexical- and sentence-level simplification, leaving long text simplification comparatively unexplored . |
| Approach: | They propose a two-level and progressive LLM-based framework that establishes an effective paradigm for automatic long text simplification under diverse test scenarios. |
| Outcome: | The proposed framework outperforms advanced and proprietary LLMs in in-domain and out-of-domain simplification tasks and matches or outperformed existing LLM frameworks. |
MEXA: Towards General Multimodal Reasoning with Dynamic Multi-Expert Aggregation (2025.findings-emnlp)
Copied to clipboard
| Challenge: | MEXA is a training-free framework that performs modality- and task-aware aggregation of multiple expert models to enable effective multimodal reasoning across diverse domains. |
| Approach: | MEXA is a training-free framework that performs modality- and task-aware aggregation of multiple expert models. |
| Outcome: | MEXA performs modality- and task-aware aggregation of multiple expert models . it generates interpretable textual reasoning outputs and reasons over them using a Large Reasoning Model (LRM) MEX A consistently delivers performance improvements over strong multimodal benchmarks . |